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A sub-optimal solution for optimal control 
of linear systems with unmeasurable switching delays 

A. Cicone, A. D’Innocenzo, N. Guglielmi and L. Laglia 


Abstract —We consider the optimal control design problem 
for discrete-time LTI systems with state feedback, when the ac¬ 
tuation signal is subject to unmeasurable switching propagation 
delays, due to e.g. the routing in a multi-hop communication 
network and/or jitter. In particular, we set up a constrained 
optimization problem where the cost function is the worst-case 
£.2 norm for all admissible switching delays. We first show how 
to model these systems as pure switching linear systems, and 
as main contribution of the paper we provide an algorithm to 
compute a sub-optimal solution. 

I. Introduction 



Fig. I. State feedback control scheme. 


Wireless networked control systems are spatially dis¬ 
tributed control systems where the communication between 
sensors, actuators, and computational units is supported by 
a wireless multi-hop communication network. The main 
motivation for studying such systems is the emerging use of 
wireless technologies for control systems (see e.g. [1] and 
references therein) and the recent development of wireless 
industrial control protocols (such as WirelessHART and 
ISA-100). Although the use of wireless networked con¬ 
trol systems offers many advantages with respect to wired 
architectures (e.g. flexible architectures, reduced installa¬ 
tion/debugging/diagnostic/maintenance costs), their use is 
a challenge when one has to take into account the joint 
dynamics of the plant and of the communication protocol. 
Recently, a huge effort has been made in scientific research 
on Networked Control Systems (NCS) and on the interaction 
between control systems and communication protocols, see 
e.g. [2], [3], [4], [5], [6]. In general, the literature on NCSs 
addresses non-idealities (e.g. quantization errors, packets 
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dropouts, variable sampling and delay, communication con¬ 
straints) as aggregated network performance variables or 
disturbances, neglecting the dynamics introduced by the 
communication protocols. To the best of our knowledge, 
the first integrated framework for analysis and co-design 
of network topology, scheduling, routing and control in a 
wireless multi-hop control network has been presented in 

[7] , where switching systems are used as a unifying formal¬ 
ism for control algorithms and communication protocols and 
sufficient conditions for stabilizing the plant are provided. In 

[8] the networked system is sampled at the time scale of the 
period of the communication protocol scheduling, and this 
makes the system discrete-time linear time-invariant. 

In [14] we refined the above model and considered a net¬ 
worked system sampled at the more accurate time scale of the 
transmission slots of each communication node: this makes 
the system discrete-time switching linear, which is a much 
more difficult mathematical framework. In particular, we 
assumed in our model that a multi-hop network Q provides 
the interconnection between a state-feedback discrete-time 
controller C and a discrete-time LTI plant V (see Figure [T]i. 
The network Q consists of an acyclic graph where the node 
Vc is directly connected to the controller and the node Va is 
directly connected to the actuator of the plant. As classically 
done in (wireless) multi-hop networks to improve robustness 
with respect to node failures we assume that the number 
of paths that interconnect C to 7^ is greater than one and 
that for any actuation data sent from the controller to the 
plant a unique path is chosen. Each path is characterized 
by a delay in forwarding the data (see [8] for details), as 
a consequence each actuation data will be delayed of a 
finite number of time steps according to the chosen routing: 
as a consequence our system is characterized by switching 
time-varying delays of the input signal, due to routing as 
well as jitter. Since usually jitter is unpredictable and the 
routing choice depends on the internal status of the network, 
i.e. because of node and/or link failures, we considered 
the choice of the routing path and/or jitter effects as an 
external disturbance. In practical applications measurability 
of such disturbance switching signal (that represents the 
network induced delays at each time step) depends on the 
protocol used to route data (see [12] and references therein 
for an overview on routing protocols for wireless multi¬ 
hop networks). If the controller node Vc of Q is allowed by 
the protocol to choose a priori the routing path (e.g. source 
routing protocols), then we can assume that the controller 
is aware of the routing path and the associated delay, and 
therefore can measure the switching signal. If instead the 















protocol allows each communication node to choose the next 
destination node according to the local neighboring network 
status information (e.g. hop-by-hop routing protocols) then 
we cannot assume that the controller can measure the switch¬ 
ing signal. In [14] we first characterized stabilizability in 
the case when the switching signal is measurable, then we 
showed with some examples that when it is unmeasurable 
it is much harder to decide stabilizability, e.g. it can be 
necessary to make use of nonlinear controllers for stabilizing 
a linear plant. 

Motivated by these results and examples, we address in 
this paper the control design problem when the switching 
signal is unmeasurable. In particular, we set up a constrained 
optimization problem where the cost function is the worst- 
case £2 norm for all admissible switching delays. We first 
show how to model these systems as pure switching linear 
systems, and as the main contribution of the paper we provide 
an algorithm to compute a sub-optimal solution. To the 
best of our knowledge this problem for linear systems with 
switching delays has not been addressed from the scientific 
literature so far. Also, since in our model we take into 
account the realistic situation where delay variations can be 
due to both routing in a multi-hop communication network 
and jitter, the set of admissible switching delays can be very 
large: indeed jitter can generate small delay variations, but 
routing via different paths can generate very large delay 
variations. As a consequence, classical robust control design 
approaches that are based on the assumption of slight delay 
variations around a central nominal delay are not applicable 
to our model. Also, since disturbances due to routing and 
jitter cannot be generally described by some predictable 
scheme or mathematical model, methods for estimation and 
prediction of the delay is generally useless. 

Relating our results to the existing literature, we remark 
that analysis and controller design for systems with time- 
varying delays have attracted increasing attention in recent 
years (see e.g. [9], [10], [15], [11], [17], [35] and refer¬ 
ences therein). In particular, in [16] it is assumed that the 
time-varying delay is approximatively known and numerical 
methods are proposed to exploit this partial information for 
adapting the control law in real time. Our modeling choice 
is close to the framework in [10]. However our setting is 
more general and realistic in that, differently from [10], 
it allows for several critical phenomena to happen: In our 
model, control commands generated at different times can 
reach the actuator simultaneously, their arrival time can be 
inverted, and it is even possible that at certain times no 
control commands arrive to the actuator. These phenomena 
are well known to be responsible for controllability issues 
in Multi-hop Control Networks. In summary, our contri¬ 
bution is providing a novel sub-optimal approach (which 
is reasonable, since the problem is still highly non-linear) 
leveraging the special structure induced by the switching 
delays and exploiting previous results on the computation 
of the extremal norm of a set of matrices. 

The paper is organized as follows. In Section|n]we provide 
the modeling framework and the problem formulation. In 


Sections m and EYl we first overview and then provide 
the main results of the paper. In Section we apply our 
procedure to an illustrative example. In Section we 
provide concluding remarks and open problems for future 
research. 

II. Model and problem formulation 

Consider a discrete-time linear time invariant system V 
described by the following difference equation: 

x{k -f 1) = Apx{k) -I- Bpu{k), k >0, 

where x G M”, u G K™, Ap G Bp G 

Figure [1] illustrates a state-feedback control scheme: the ob¬ 
jective is that the state signal x{k) is as close as possible to a 
reference signal r{k) G R". In this paper we assume that the 
reference signal r(fc) = 0, i.e. we wish to drive the state to 
its equilibrium point in the origin. The extension to the more 
general case when the reference signal is a Heaviside step 
function can be approached using a change of variable and 
the use of an integrator or a feed-forward term in the control 
scheme, and is out of the scope of this paper. We assume 
that the control signal v{k) generated by the controller C is 
transmitted to the actuator of the plant V via a multi-hop 
network. The network Q consists of an acyclic graph {V^ E), 
where the node Vc G V directly interconnected to the 
controller C, and the node Va is directly interconnected to the 
actuator of the plant V. In order to transmit each actuation 
data v(k) to the plant, at each time step k a unique path of 
nodes that starts from Vc and terminates in Va is exploited. As 
classically done in multi-hop (wireless) networks to improve 
robustness of the system with respect to node failures, we 
exploit redundancy of routing paths, therefore the number 
of paths that can be used to reach Va from Vc is assumed 
to be greater than one. To each path a different delay can 
be associated in transmitting data from Vc to Va, depending 
on the transmission scheduling and on the number of hops 
to reach the actuator. Since the choice of the routing path 
usually depends on the internal status of the network (e.g. 
because of node and/or link failures, bandwidth constraints, 
security issues, etc.), we assume that the routing path chosen 
at each time step k is time-varying. Therefore the actuation 
command v{k) at time k will be delayed, according to the 
chosen routing path and the jitter, of a finite number of time 
steps, which we model as a disturbance signal a{k). For the 
reasons above, we can model the dynamics of a multi-hop 
control network as follows: 

Definition 1: The dynamics of the interconnected system 
A/^ can be modeled as 

Xf.{k + \) = AXf.{kl)B{a{k))v{k), fc > 0, (1) 

where x^ = [a:"'" uj ■■■ G Ui,i = 

V G R™, a{k) G D, for any fc > 0, 
is a disturbance switching signal taking value in the set 
D C {0,1 , 2 ,..., dmax}, which is the set of possible delays 
introduced by all routing paths with dmax the maximum 


III. Overview of the proposed method 
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where (5i CT(fc),Vi G {0, ■ ■ ■ ,dmax},k > 0 is the Kronecker 
delta and is the identity matrix of dimension m. 

We also assume that the controller is not aware of the 
switching signal cr(fc), but it can measure the error signal 
e{k) = x{k) — r{k), where the reference signal r{k) is 
considered for simplicity constantly zero for every k >0, as 
already discussed, hence e{k) = x(k). As a consequence of 
these assumptions, we can not assume that the controller can 
measure the variables Ui ■ ■ ■ We can instead assume 

that the controller keeps memory of the last dmax measures 
of the error signal, namely e(k — 1 ),, e(k — dmax)'- 


Definition 2: Assume that the switching signal cannot be 
measured at any time instant. We define a control law as 
follows: 


v{k) = K[e^{k), e'^(fc-l), ..., {k - dmax)]^, 

K =[KqKx--- Kd^^J e ( 2 ) 

Therefore the closed-loop system behavior consists of the 
extended state space 

ye{k) = [e^{k), e^{k-l), e^{k - dmax), 

(3) 

If we define E as the set of all switching signals of infinite 
length cr = (cr( 0 ), ...) we can formulate the main 

goal of our research 

Problem 1: Fixed the plant parameters Ap and Bp, we 
want to design the controller AT in (| 2 ]l such that the following 
cost function is minimized: 

OO 

min/7 = minmax ilell^ =minmax> ||e(fc )||9 (4) 

K K ctGE ^ K ctGE 

fc =0 

In other words, we want to design a controller that 
minimizes the worst case £ 2 -norm of the error signal over 
all the possible infinite length switching signals ct G E. 

Since the cardinality of E is infinite, the problem in hand, 
to the best of the authors’ knowledge, cannot be solved 
exactly. For this reason, in the next Section we develop 
an approximation method which allows to produce upper 
bounds for (|4|i. 


For a switched control system given by O and da we 
aim to compute a sharp upper bound for the £ 2 -norm of 
the sequence {e{k)}k>o over all possible switching laws 
and minimize this quantity with respect to the parameters of 
the controller Kq, Ki, ... ATdmax- ^ necessary and sufficient 
condition for the sequence being in £2 is that the joint spectral 
radius of the associated set of matrices is smaller than 1 : 
it is well known, in fact, that the maximal rate of growth 
among all products of matrices from a finite set A4 is given 
by the Joint Spectral Radius (JSR) of A4, p{M), which is 
the generalization of spectral radius to sets of matrices [18], 
[19], [20], [21], [22], [23], [13]. 

Motivated by this observation we first minimize the joint 
spectral radius with respect to K = [Kq Ki ■ ■ ■ ATdmax] by a 
descent algorithm and then estimate the associated £ 2 -norm. 
The minimization of the joint spectral radius can be done 
directly on the underlying set of matrices to the switched 
system given by ([T]l and (| 2 ]l. In order to get a sharp estimate 
of the f 2 -norm we propose an approximation framework 
based on the identification of a certain polytope norm || • \\p 
(computed as we describe below) and its mathematical 
relation with the 2-norm of the variable e(fc). Since the 
dynamics of the switched control system given by ([T]i and (| 2 |i 
also involves the actuation variable Ui(k),i = 1,..., dmax, 
such formal relation is hard to state. To overcome this 
difficulty we derive which is an equivalent formulation of 
the switched control system given by O and (| 2 |l, that only 
involves the sequence {e(fc)}, but leads to an augmented 
formulation that extends the state dimension of the system to 
2dmax + 1- This is done by considering switching sequences 
of a certain length (for example 2 in the case D = {0, 1}), 
which however implies some constraint in the new system 
(for example the control sequence 00 cannot be followed by 
the sequence 11) and gives a Markovian structure [24] to the 
joint spectral radius problem. This problem can be solved 
by a suitable lifting of the matrices (recently proposed by 
Dai and Kozyakyn [25], [24]) of the set which determines 
an equivalent classical joint spectral radius problem for a 
new set of matrices. According to a methodology which 
has been recently developed [34], [31], [27], we compute 
the joint spectral radius by determining a polytope extremal 
norm (which we indicate as || • ||p) of a set of matrices B. In 
order to compute a bound for the £2 norm we have to find 
a constant which relates the computed polytope norm || • \\p 
and the 2 -norm, i.e. ||a:|| < CpHtcljp and use the fact that 
for all matrices F € B of the set we have ||F||p = p{B). 
This can be done efficiently by computing the dual polytope 
to the one computed by our algorithm. This estimate is useful 
to bound (by a geometric series) the norm of the sequence 
{e{k)}k>ri for 77 an arbitrarily chosen natural number. For 
the first part of the sequence, which in many cases gives 
the most important contribute to the estimate, we compute 
directly all matrix products of degree smaller than t < p in 
the product semigroup and then use another estimate (still 
based on the construction of certain polytopes) to estimate 








the products of length t + 1 < k < ij (an intermediate 
regime), which usually provides better bounds with respect 
to the geometric estimate, and which we shall describe in 
the following sections. 

IV. Main results 

From now on we focus our attention on the case of 
m = 1 , thus e{k), e{k — 1 ), ..., e(k — dmax) S R" and 
Ml, • • • € R. We assume that the initial conditions 

are given by an arbitrary e(0) while Vfc < 0, e{k) = 0 G R". 

Before stating the main results we present a technical 
Lemma. 

Lemma 1: Given the system ([T]i and the control law (|2]i. 

Then, for every k > 0 

Se{k + 1) = N^(k),...,,T{k-d^a.x)^e{k), (5) 

with ee(fc) = (k - 1),..., (k - 2dmax)]'^, 

«,(i). 6 +>»’, and 

■V = }.... W\ = IDI"-*' «.) 

Proof: We start rewriting the system O, together with 
the control law (l 2 ]l, as follows; 

ye{k + l) = M{a{k))yf,{k), (7) 

for every k > 0, where 

e{k + l) = Ape{k) + Bpui{k) + BpSo^a(k)vik) 
e{k) = e{k) 


of a graph whose nodes correspond to matrices in Af. For 
example the edge from node TVio to node Nu represents the 
product TVii Note that the outdegree (i.e. the number of 
outgoing edges) of each vertex is equal to 2 = |{ 0 , 1 }|: it is 
easy to see that, in the general case, the outdegree of each 
vertex is equal to \D\. 

We observe that in the continuous time case the idea of 
admissible transitions between subsystems goes under the 
name of constrained switching and has been studied, for 
example, in [32]. 



Given ee{k + l) = N„(k),...,crik-d^^x:)^e{k), Vfc > 0, then 

OO OO 11 / T,\ 112 

we see immediately that ^ ||e(fc )||2 = 2 d 4 - 1 - 

k=0 k=0 

The main result of this paper can be summarized as 
follows 

Proposition 2: Given O and the control law 0 , 

There 3 C > 0 such that 


e(A; -f 1 dmax') 

— e(/t {dmax 1)) 

ui{k + 1) 

= W2(A:) 

+ 1) 

= {k) + 

'^dmaxik + 1) 



Then, we note that the dynamics of Ui{k) are given by 


Ul{k) =(5l,<,(fe-l)M(fc - 1) + 52,a(k-2)V{k - 2) 

+ • • ■ + ^dma.x,'y{k-dmax)'^{k — dmax) ■, 

hence, by (|2]l, 

dma^: 

e{k + 1) = Ape{k) + _Bp ^ ^i,a{k-i)'v{k - i) 

i=0 

dyndcc dfddx 

^ Ape{k) + Bp ^ Si,x{k-i) ^ Kje{k - i- j) 

i=0 j=0 

Then the conclusion follows. ■ 

Remark 1: It is clear that not all products of matrices in Af 
are allowed. More precisely, if at time k the switching matrix 
defining the system dynamics is given by dLd^,...,dk-dma.x’ 
then at time k + 1 the set of allowed matrices is given 
by the set + 1) e D} with 

cardinality \D\. In Figure |2] we represent, for instance, the 
admissible left products for D = {0, 1} by means of edges 


—min[ max V ||ee(fe)ll2 + 

(8) 

where o'^a,b] is the string of switching signals contained in 
a from position a G No to 6 G No, Lfc, fc > 0 are properly 
constructed polytopes, and p{Af) is the Joint Spectral Radius 
of the set of matrices obtained as a special lifting of the set 

N. 

To prove this Proposition we need a few intermediate 
results. 

Lemma 3: Given the function J, defined in Problem [1] 
Then 

^ OO 

\\Pk{cr)ee{0)\\l (9) 

k=0 

where Pk{<y) is the product of matrices in Af associated with 
the first k values in a for k > 0, and P[j{<j) = I„ is the 
identity matrix. 

Proof: From the definition of ff and the extended error 
vectors £e{k) it follows 

K ^CLmax “r -L ^ crfcZj 

Hence, from Lemma □ ® follows directly. ■ 

Remark 2: Considering that the cardinality of E is in¬ 
finite, we can make the computational complexity feasible 
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by computing upper bounds for (|9]l using the Joint Spectral 
Radius theory. In particular it holds true that 

p{M)= \im sup (11) 

k^oo 

for any matrix norm || • ||, where ¥k{Ai) is the set of all 
products of length k of matrices in M. Furthermore 

P(-^) = inf sup IIAll (12) 

II'IIgo AeM 

where O denotes the set of all possible operator norms. We 
observe that, if the set A4 € is irreducible, which 

means that only the trivial subspaces {0} and are 

invariant under the action all the matrices in A4, then the 
inf in (fT^ is actually achieved for some induced norm || • ||» 
which is said to be extremal for the set A4 [33]. 

In the problem under study, however, not all the products 
of matrices in are allowed, as explained above. Admissible 
ones induce a Markovian structure [24] of the switching 
sequences. For instance, in the case of D = {0, 1} the 
admissible left products can be represented as the paths of the 
graph plotted in Figure |2] Recently it has been shown that the 
maximal rate of growth among all and only the admissible 
products of matrices from a finite set j\4, which is called the 
Constrained Joint Spectral Radius (CJSR), can be computed 
through the evaluation of the classical JSR of a proper lifting 
of the set M [25], [24]. 

To make use of the JSR theory in order to produce upper 
bounds for (|3) we need first the following result: 

Lemma 4: Given an induced poly tope norm || • ||p for a 
finite dimensional space S, whose unit ball is the polytope 
P, then ||A||2 < CHAUp for any A G S', where C < 
R{P)R{P*) and R{P), R{P*) are the circumradii of P and 
its dual, P*, respectively. 

Proof: Given the finite dimensional space S, the 

induced poly tope norm || • ||p and the poly topic unit ball 
P, by the equivalence of norms in finite dimensional spaces, 
there exists a constant of equivalence C such that ||A||2 < 
C||A||p for any A G S. Furthermore it is easy to check that 
C < , where R(P) and r(P) are the circumradius and 

inradius of P, respectively. By [28, Theorem 1.2], it follows 
that C < R{P)R{P*). m 

Remark 3: There are many well studied algorithms that 
allow to build the dual P* of a polytope P, like for instance 
the one described in [29]. Furthermore we point out that 
the circumradius of a poly tope P and its dual, P*, can be 
evaluated easily as the maximum length of vertices on the 
boundary of P and P*. 

Lemma 5: Consider (|9]) and a set of matrices 77 produced 
as a lifting of the matrices in 77, as showed by means of 
an example in the next Section. Assuming that the set 77 
is irreducible and it does admit an extremal polytope norm 
II • II* such that ||W||* < p{77) for any N G 77, 

Then 

- 2d — p 1 "k" ^ p(Nf’‘ l|£e(0)||2 + ||ee(0)||2 j (13) 


where C is the constant of equivalence such that ||A||2 < 

CIIAII*, for any A G ^ 

tence is guaranteed by the equivalence of norms in finite 

dimensional spaces. 

Proof: Following the ideas presented in [24], we 
consider a new set 77 containing |£)|^m<i^+i matrices of 

size {n{2draax + 1)|U|‘^™'““’) which are given by a special 
lifting of the matrices in 77. The two sets are such that 
the JSR of 77 equals the CJSR of the set Jf. In the next 
Section we give an example of such a lifting. Here we 
observe that, _due to the structure of the matrices in 77, 
each product Pfe(cr), associated with the first k > 0 values 
in cr G S, does have only one non-zero block of size 
{n{2dmax + 1))^- Therefore, given any switching sequence 
tj G S, it follows that ||-Pfe(o’)||2 = ||^fe(o')||2- Furthermore, 
always due to the structure of matrices in 77, we can consider 
|£)|dmax lifted vectors ee(0)^^^ h G 
such that each of them contains blocks of size 

n{2dmax + 1) X 1 which are all zero except one that equals 
£e(0). As a consequence ||ee(0)*^^^= ||ee(0)||2 for every 
h G {1, ..., |i9|^™““'}, and, for each product Pkicr), there 
is a G {1, ..., such that ||Pfe((T)£e(0)('*)= 

||Pfc(CT)ee(0)||2- Whence (|9]l can be rewritten as 


(2dmax + 1) min J" = min max ( ^ ||Pj,(cr)ee (0) || + ||ee( 0)||2 ) 

^ ^ \k=l " / 

< minmax f ^ 2 j (14) 


By assumption we have an extremal polytope norm, so by 
Lemma |4] and the submultiplicativity of the 2-norm we get 
(OaT i where C can be derived as explained in Lemma |4] ■ 

Remark 4: In general the set 77 is irreducible, so we can 
look for a poly topic extremal norm || • ||* such that, for any 
N G 77, II A^ll* < p(77). This can be, in theory, an extremely 
hard problem. However, in general, we can build an extremal 
polytope norm following the algorithms described in [26] and 
[27]. 

Remark 5: A necessary condition to have a finite Usell^j 
is that the steady state of the extended error signal ee{k) 
is zero, which is equivalent to require that the joint spectral 
radius p(J7) is strictly smaller than 1. 

Based on this observation we can formulate the last 
Lemma 

Lemma 6: Given (|9]), the matrices Ap, Bp and assuming 
th^there exists K such that the corresponding set 77 has 
p{77) < 1. Then 

min J < —-—L_^niin ( max V \\ee{k)\\l + 

K 2dma.^ + l K es ^ 

(15) 


max II v II 2 +C^p(AA)^ 


1 - piPJY 


I|£Ao)||: 


where Vk are polytopes computed applying products of 
matrices in 77 to the initial vector £e(0), and a > p(77). 
Proof: From (|3 and Lemma|5]it follows that Problem[T] 






admits the following upper bound 


maxlleelll^ = max ( ^ ||Pfc (cr)ee ( 0 ) II2 + II ( 0 ) II 2 


+ ||P,(a)ee(0)|| = 


k = ri 


<( max ^ ||ee(fe)|l2 + max ^ ||ee(fc)||2 




1 - pijry 


l|ee( 0 )||^ 


( 16 ) 


For the terms from r + 1 to p we can construct the 
following approximation. 

Given the set JJ", which by assumption has JSR strictly 
less then 1, we consider the scaling Af = Af /a such that 
p{Af) > 1. We can use, for instance, a = m3x-^^{A)IAi 
for any /3 > 1. Hence 


II Il2=max^ II A Pk{cr)£e{0)^''^ \\l 

CTfcij ' CTfcij ' 

k=0 k=0 

< ^ _ max_ II oA Pk£e{0)^'^'‘ ||2< V' oA max || v II2 ( 17 ) 


where Pq is the identity matrix, Vk the set of vertices 
of the polytope produced at step k applying products of 
length k of matrices in M to the vector £e(0)*-^\ and 
h e is such that ||Pfe(cr)ee(0 )('')= 

\\Pk{a)eM\\l- 

Therefore 


max l|ee(A :)||2 < max V \\ee{k)\\l+ 


E 

k=T+l 


a max || v 

veVk 


(18) 


and the conclusion follows. ■ 

Remark 6: We observe that the penultimate inequality in 
(fTTl l is due to the selection, for each fixed k, of the maximum 
error norm instead of considering the maximum of the sum 
of all error norms over any possible sequence of switching 
signals cr e E. We are overestimating the summation, but 
we do not need to find anymore the infinite sequence a of 
switching signals that maximize the cost function. 

Remark 7: The last inequality in (fTTl l follows from the 
properties of the polytope which is built applying to an initial 
vector ee(0)^^l, ft. G {1, ..., all the products of 

matrices in M, where p > 1 due to the choice of the 

scaling value a. In particular, since p ^A/"^ > 1, whenever 
the produced vectors span the entire space, which is true in 
general, then some of them will tend to grow, in the limit, 
as fast as p . Furthermore, whenever a vector v ends up 

being inside the polytope Vk produced at step k, then for 
any step n > fc all the vectors generated from v they will be 
for sure inside or at most on the boundary of the polytopes 
Vn- Hence if, for any k > 1, we get rid of all the vectors 
that are not on the boundary, then max-^y^ || v ||| ends 
up being an overestimation of the quantity maxp^gp^j-^y^ || 

Hi since Vk can include vertices computed at 


previous steps instead of all and only the possible vertices 
associated with products of length k. On the other hand we 
have the advantage of drastically reducing at each step k the 
number of vertices that we need to study, as we show in the 
next Section. 

We are now ready to prove Proposition |2] 

Proof: Using Lemmas from [T] to |6] the conclusions of 
Proposition |2] follow naturally. ■ 

Remark 8: Regarding the choice of the values t and rj. 
The first r terms in (flST l have to be computed using a 
exhaustive analysis of all the switching signals with length 
smaller or equal to r, whose number increases exponentially 
with respect to r. Clearly the higher the r the more accurate 
is this approximation of the first t terms, but the higher is 
also the computational time. 

Regarding rj value, the higher rj is the more polytopes Vk 
have to be constructed, but also the higher is the accuracy 
of this bound with respect to the bound obtained exploiting 

([I3]l. 

In conclusion, one can choose rj such that the third term 
of I© is negligible, and then choose r as large as possible 
(to increase the overall accuracy) until the computational 
complexity (which increases exponentially with r) remains 
feasible. 


V. Numerical Examples 


In this Section we present some numerical examples of 
the application of the above technique. We concentrate our 
analysis to cases with D = {0, 1}, but we point out that 
the proposed method allows to deal with any possible set of 
delays D. 

As we mentioned in the previous Section, the maximal 
rate of growth of admissible products of matrices from the 
finite set Af ®, the Constrained Joint Spectral Radius of AT, 
can be computed through the evaluation of the classical JSR 
of a proper lifting of Af [24]. 

In the case of U = {0, 1} the lifted set is 


M={Noo, TVio, Noi, Wn} c 
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block triangular- 


whose JSR p{Af) equals the CJSR of set Af. Furthermore the 

A. • TT 1 I H-Gn 

unitary matrix U = ^ „ 

llGn —JlGn 

izes the set Af which becomes Af, such that p{Af) equals 
p{Af') where 




0 


]} 




with h, k ^ {0, 1}. 













Given the block triangular structure of this set it follows that 
p{.hf') equals p(N) where 


0 


0 Nq\ 
0 0 


0 0 

A^io 0 



So we work directly with the lifted set U such that p(M) 
equals the CJSR of the set M, defined in (|6]). 

We point out that the previous procedure can be directly 
extended to the case of delays D C {0,1,2,..., dmax}- 

In this paper we focus on the case n = 1 which already 
presents the main features of the general case n S N, 
and without loss of generality we assume that 6 = 1. 
Furthermore, to avoid trivial cases, we consider values of 
a such that |a| > 1. 

We observe that, from the numerical results we produced, 
for any a < — 1 and for any K the system appears to be non 
controllable. Hence we focus our attention on cases where 
a > 1. We consider, in particular, a = 1.1 and 1.5. 

Remark 9: The equations (l8]l have to be minimized over 
all possible values K. From (fOT l it is clear that there are 
only two quantities that can influence the right end side of ® 
which are p(J^) and the equivalence constant C. We observe 
that, for n = 1, the value of C does not depend much on the 
quantity K and that the JSR of a set of matrices is locally 
Lipschitz continuous with respect to any change in the entries 
of the matrices in the set [30]. Therefore, in order to obtain 
tighter upper bounds from we can apply any standard 
minimization technique valid for continuous functions and 
numerically minimize the quantity p{M) over iT’s. 

1) Case a = 1.1.' As explained in the previous 

sections we compute an upper bound for Problem [1] 
In particular we hrst compute, using a greedy method, 

T 

maxg-p^jes ll^e(fc)||2 for a feasible value r which, in 

k=0 

this example, is set to 9. In Figure [3] (left) we plot in 
solid blue the values ||£e(^)||2 for 0 < fc < 9. Then, after 
obtaining the values Kq « —0.6085 and Ki Ri 0.0941 from 
the minimization of the joint spectral radius of the set TV" by 
means of the default Matlab code fminsearch, we build 
the corresponding polytopes Vk and evaluate the quantity 
ELr+i max-gy^ || v |||, ref. Figure [3] (left) black 
dotted curve. For a = 1.1 the number of vertices in the 
poly tope Vk after 50 steps is simply 166 versus a theoretical 
number of vertices. We observe that the number of 
vertices of for all the values of a > 1 we tested, is always 
almost constant, around 140, and independent on the step 
number k. Finally, following [31], we construct a polytopic 
extremal norm for the set Af. We compute the constant of 
equivalence of the extremal polytope norm for Af with the 
2 -norm, as explained in the previous section, and produce 
the values plotted using magenta crosses in Figure 0 (left). 
We point out that for 0 < A: < 9 the total greedy method 
estimate is approximately 33.1, while the one by polytope 
method is around 52.2. Finally we observe that in this case 
the tail of the upper bound estimate, which is given by the 
third term in right hand side of (O, is smaller than 10“^^. 

2) Case a = 1.5.' As before, we run a greedy method 
up to T = 9, Figure 0 (left) solid blue curve. From the 



Fig. 3. Upper bounds in (D computed for a = 1.1. 


minimization of the joint spectral radius of Af we get the 
values Kq fv —0.9047 and Ki ss 0.1430 , for 10 < A; < t 
we build the poly topes Vk, as showed in Figure [3] (left) 
black dotted curve. This time the number of vertices in 
V50 steps is 156 versus, again, a theoretical number of 4^° 
vertices. Finally we compute the constant of equivalence 
of the polytopic extremal norm with the 2-norm which is 
around 90.7, magenta crosses in Figure |3] (left). In this 
example for 0 < A: < 9 the total greedy method estimate 
is approximately 106.9, while the polytopes one is around 
163.6. Finally the third term in right hand side of ® in this 
case is smaller than 10~^. 



Fig. 4. Upper bounds in computed for a = 1.5. 


These two examples show that the construction of the 
polytopes Vk, which allows to speed up the calculations by 
means of a drastic reduction of the number of vertices at 
every k, allows to compute an upper bound for the error 
signal minif which proves to be close to the greedy 
estimates in all the tests we ran. Furthermore the calculation 
of C, the constant of equivalence between norms, allows to 
complete the estimate of this upper bound in finite time. 

VI. Conclusions and future work 

We addressed the optimal control design problem for 
discrete-time LTI systems with state feedback, when the 
actuation signal is subject to unmeasurable switching propa¬ 
gation delays, due to e.g. the routing in a multi-hop commu¬ 
nication network and/or jitter. Solving this problem for gen¬ 
eral switching systems is a challenging and open problem. 
Our contribution is providing a sub-optimal approach (which 
is reasonable, since the problem is still highly non-linear) 
leveraging the special structure induced by the switching 
delays and exploiting previous results on the computation 
of the extremal norm of a set of matrices. 
















In future work we will more deeply investigate the ac¬ 
curacy of our approach with respect to its computational 
complexity (related to the variables r, p and C), extend our 
methods for solving the LQR problem for our mathematical 
model, and apply our results to realistic case studies. Also, 
we will extend our results to the output-feedback setting; in 
this case the technical challenges strongly depend on the fact 
that the communication network allows timestamping or not. 

References 

[1] S. Han, Z. Xiuming, K. M. Aloysius, M. Nixon, T. Blevins and D. 
Chen. Control over WirelessHART network. Proc. of the 36^^ Annual 
Conference on IEEE Industrial Electronics Society (lECON 2010), 
pp.2114-2119, 2010. 

[2] H. Lin and P. Antsaklis. Stability and Stabilizability of Switched Linear 
Systems: A Survey of Recent Results. IEEE Transactions on Automatic 
Control, 54(2):308-322, 2009. 

[3] V. Gupta, A. F. Dana, J. P. Hespanha, R. M. Murray and B. Hassibi. 
Data Transmission Over Networks for Estimation and Control. IEEE 
Transactions on Automatic Control, 54(8):1807-1819, 2009. 

[4] J. P. Hespanha, P. Naghshtabrizi and Y. Xu. A Survey of Recent Results 
in Networked Control Systems. Proceedings of the IEEE, 95(1):138- 
162, 2007. 

[5] W.P.M.H. Heemels, A.R. Teel, N. van de Wouw and D. Nesic. Net¬ 
worked Control Systems With Communication Constraints: Tradeoffs 
Between Transmission Intervals, Delays and Performance. IEEE Trans¬ 
actions on Automatic Control, 55(8):1781-1796, 2010. 

[6] M. Tabbara, D. Nesic and A. R. Teel. Stability of Wireless and Wireline 
Networked Control Systems. IEEE Transactions on Automatic Control, 
52(7): 1615-1630, 2007. 

[7] R. Alur, A. DTnnocenzo, K. H. Johansson, G. J. Pappas and G. Weiss. 
Compositional Modeling and Analysis of Multi-Hop Control Networks. 
IEEE Transactions on Automatic Control, Special Issue on Wireless 
Sensor and Actuator Networks, 56(10):2345-2357, 2011. 

[8] A. DTnnocenzo, M.D. Di Benedetto and E. Serra. Fault Tolerant Con¬ 
trol of Multi-Hop Control Networks. IEEE Transactions on Automatic 
Control, 58(6):1377-1389, 2013. 

[9] X. G. Liu, R. R. Martin, M. Wu and M. L. Tang. Delay-dependent 
robust stabilisation of discrete-time systems with time-varying delay. 
lEE Proc. on Control Theory AppL, 153(6):689-702, 2006. 

[10] L. Hetel, J. Daafouz and C. lung. Stability analysis for discrete 
time switched systems with temporary uncertain switching signal. 
Proceedings of the 46^^ IEEE Conference on Decision and Control 
(CDC2007), New Orleans, LA, USA, December 12-14, pp.5623-5628, 
2007. 

[11] H. Shao and Q.-L. Han. New Stability Criteria for Linear Discrete- 
Time Systems With Interval-Like Time-Varying Delays. IEEE Trans¬ 
actions on Automatic Control, 56(3):619-625, 2011. 

[12] Y. Yang, J. Wang and R. Kravets. Designing routing metrics for mesh 
networks. Proc. of the IEEE Workshop on Wireless Mesh Networks 
(WiMesh2005), Santa Clara, CA, 2005. 

[13] R. M. lungers. The joint spectral radius, theory and applications. 
In Lecture Notes in Control and Information Sciences, volume 385. 
Springer-Verlag, Berlin, 2009. 

[14] R. M. lungers, A. DTnnocenzo, M. D. Di Benedetto. Controllability 
of Linear Systems with Switching Delays. IEEE Transactions on 
Automatic Control, to appear in April 2016 

[15] W. P. M. H. Heemels, A. R. Teel, N. van de Wouw and D. Nesic. 
Networked Control Systems with Communication Constraints: Trade¬ 
offs between Transmission Intervals, Delays and Performance. IEEE 
Transactions on Automatic Control , 55(8), p. 1781-1796, 2010. 

[16] L. Hetel, J. Daafouz, J.-P. Richard and M. lungers. Delay-dependent 
sampled-data control based on delay estimates. Systems and Control 
Letters, 60(2): 146-150, 2011. 

[17] W. Lombardi, S. Olaru, S.-I. Niculescu and L. Hetel. A predictive 
control scheme for systems with variable time-delay. International 
Journal of Control, 85(7):915-932, 2012. 

[18] G. C. Rota, G. Strang. A note on the joint spectral radius. Indagatione 
Mathematicae, 22:379-381, 1960. 

[19] M. A. Berger, Y. Wang. Bounded semigroups of matrices. Linear 
Algebra and its Applications, 166:21-27, 1992. 


[20] J. C. Lagarias, Y. Wang. The finiteness conjecture for the generalized 
spectral radius of a set of matrices. Linear Algebra and its Applications, 
214:17-42, 1995. 

[21] I. Daubechies, J. C. Lagaiias. Sets of matrices all infinite products 
of which converge. Linear Algebra and its Applications, 161:227-263, 
1992. 

[22] N. Guglielmi, M. Zennaro. An algorithm for finding extremal 
polytope norms of matrix families. Linear Algebra and its Applications, 
428:2265-2282, 2008. 

[23] A. Cicone. A note on the Joint Spectral radius. arXiv:1502.01506 
2015 

[24] V. Kozyakin. The Berger-Wang formula for the Markovian joint 
spectral radius. Linear Algebra and its Applications, 448:315-328, 
2014. 

[25] X. Dai. Robust periodic stability implies uniform exponential stability 
of Markovian jump linear systems and random linear ordinary differ¬ 
ential equations. Journal of the Franklin Institute, 351(5):2910-2937, 
2014. 

[26] A. Cicone, N. Guglielmi, S. Serra-Capizzano, M. Zennaro Finiteness 
property of pairs of 2x 2 sign-matrices via real extremal polytope 
norms. Linear Algebra and its Applications, 432(2):796-816, 2010. 

[27] N. Guglielmi, V. Protasov Exact computation of joint spectral 
characteristics of linear operators. Foundations of Computational 
Mathematics, 13(l):37-97, 2013. 

[28] P. Gritzmann, V. Klee Inner and outer j-radii of convex bodies in 
finite-dimensional normed spaces. Discrete & Computational Geome¬ 
try, 7(l):255-280, 1992. 

[29] D. Avis A revised implementation of the reverse search vertex 
enumeration algorithm. Polytopescombinatorics and computation. DMV 
Seminar., 29:177-198, 2000. 

[30] F. Wirth The generalized spectral radius is strictly increasing. Linear 
algebra and its applications, 395:141-153, 2005. 

[31] N. Guglielmi, F. Wirth, M. Zennaro. Complex polytope extremality 
results for families of matrices. SIAM J. Matrix Analysis AppL, 27:721- 
743, 2005. 

[32] M. Souza, A.R. Fioravanti, R.N. Shorten Dwell-time control of 
continuous-time switched linear systems Proceedings of the 53^^ IEEE 
Conference on Decision and Control (CDC2014), Los Angeles, CA , 
USA, December 15-17, 2014. 

[33] N. E. Barabanov. Lyapunov indicator of discrete inclusions. I-III. 
Autom. Remote Control, 49 (2,3,5): 152-157, 283-287, 558-565, 1988. 

[34] V. Yu. Protasov. The joint spectral radius and invaiiant sets of the 
several linear operators. Fundamentalnaya i prikladnaya matematika, 
2(1):205-231, 1996. 

[35] C.-Y. Kao and A. Rantzer Stability Analysis of Systems with Uncertain 
Time-Varying Delays. Automatica, 43(6):959-970, 2007. 

[36] A. Cicone, A. DTnnocenzo, N. Guglielmi and L. Laglia A sub-optimal 
solution for optimal control of linear systems with unmeasurable switch¬ 
ing delays Proceedings of the 54^^ IEEE Conference on Decision and 
Control (CDC2015), Osaka, Japan, December 15-18, 2015. Preprint 
available at arXiv:1108.5316 


